Simulating Ovariohysterectomy: What Type of Practice Promotes Short- and Long-Term Skills Retention?

Simulation-based surgical training allows students to learn skills through deliberate practice without the patient risk and stress of operating on a live animal. This study sought to determine the ideal distribution of training sessions to improve short- and long-term retention of the skills necessary to perform a simulated ovariohysterectomy (OVH). Fourth-semester students (n = 102) were enrolled. Students in the weekly instruction group (n = 57) completed 10 hours of training on the OVH simulator, with sessions held at approximately weekly intervals. Students in the monthly instruction group (n = 45) completed the same training with approximately monthly sessions. All students were assessed 1 week (short-term retention test) and 5 months following the last training session (long-term retention test). Students in the weekly instruction group scored higher on their short-term assessment than students in the monthly instruction group (p < .001). However, students' scores in the weekly instruction group underwent a significant decrease between their short- and long-term assessments (p < .001), while the monthly group did not experience a decrease in scores (p < .001). There was no difference in long-term assessment scores between weekly and monthly instruction groups. These findings suggest that if educators are seeking maximal performance at a single time point, scheduling instructional sessions on a weekly basis prior to that time would be superior to monthly sessions, but if educators are concerned with long-term retention of skills, scheduling sessions either on a weekly or monthly basis would accomplish that purpose.

Self-Efficacy and Student Satisfaction in a Clinical-Year Diagnostic Imaging Course Using an Online Instruction Format.

Accurate interpretation of radiographic images is critical to diagnosing clinical patients. Remote instruction in radiology has become more common at veterinary colleges as academic institutions struggle to fill open veterinary radiologist positions and as a result of the COVID-19 pandemic. This study sought to gather the feedback of fourth-year veterinary students via pre- and post-study surveys (n = 45) and focus groups (n = 7) about a newly implemented 2-week long radiology rotation. Ninety-eight percent of students reported having taken an online course before, and on both pre- and post-study surveys, students commonly reported feeling interested, determined, and attentive. On average, students reported that they were neither more nor less engaged than they would have been in an in-person course and that they understood the material neither better nor worse than they would have in an in-person course. Students reported that the key to their success was primarily hard work; secondarily, instructor availability and student ability were important. Students did not rate luck as having much influence on their success. Although diagnostic imaging can be a challenging subject to master, students effectively learned this subject through online instruction. They provided feedback for the course's continued improvement; their comments centered around improved interactivity, including providing automated quiz questions' answers and increased instructor availability. Data collected in this study will help to guide further development of the radiology course.

The Impact of the COVID-19 Pandemic on Veterinary Clinical and Professional Skills Teaching Delivery and Assessment Format.

The limitations posed by the COVID-19 pandemic have been particularly challenging for courses teaching clinical and professional skills. We sought to identify how the COVID-19 pandemic has impacted the delivery of veterinary clinical and professional skills courses, including modifications to teaching and assessment, and to establish educators' perceptions of the efficacy of selected delivery methods. A branching survey was deployed to 35 veterinary schools in North America in March and April 2021. The survey collected data about curriculum and assessment in spring 2020, fall 2020, and spring 2021. Educators at 16 veterinary schools completed the survey (response rate: 46%). Educators quickly adapted curriculum to meet the requirements of their institutions and governments. Early in the pandemic (spring 2020), curriculum was delayed, delivered remotely, or canceled. Assessment methods frequently included virtual objective structured clinical examinations (OSCEs) and video-recorded skills assessments. Later in the pandemic (fall 2020, spring 2021), in-person clinical skills sessions resumed at many schools, often in smaller groups. Professional skills instruction typically remained virtual, as benefits were noted. Assessment methods began to normalize with in-person OSCEs resuming with precautions, though some schools maintained virtual assessments. Educators noted some advantages to instructional methods used during COVID, including smaller group sizes, better prepared students, better use of in-person lab time, more focus on essential course components, provision of models for at-home practice, and additional educators' remote involvement. Following the pandemic, educators should consider retaining some of these changes while pursuing further advancements, including improving virtual platforms and relevant technologies.

Online Case-Based Course in Veterinary Radiographic Interpretation Generates Better Short- and Long-Term Learning Outcomes than a Virtual Lecture-Based Course.

Accurate interpretation of radiographs is necessary for the correct diagnosis and treatment of patients. Research has shown that active learning methods, including case-based learning, are superior to passive learning methods, such as lectures.1,2 Short-term learning outcomes were compared between two groups by enrolling 80 fourth-semester veterinary students in either an online case-based radiology course (n = 40) or a virtual lecture-based course (n = 40). Long-term learning outcomes were compared among three groups: one group completed case-based instruction in the fourth semester, followed by lecture-based instruction in the fourth semester (n = 19); the second group completed only lecture-based instruction in the fourth semester (n = 22), and the third group completed lecture-based instruction in the fourth semester, followed by case-based instruction in the fifth semester (n = 9). Learning was assessed using a multiple-choice examination and two independently written small animal radiograph reports. In the fourth semester, students completing the case-based course had higher examination scores and radiograph report scores than students who took the lecture-based course. Students completing the lecture-based course in the fourth semester and the case-based course in the fifth semester wrote better radiograph reports than students who completed both courses in the fourth semester; both groups wrote better reports than students who did not take the case-based course. A case-based diagnostic imaging course may be better than a lecture-based course for both short- and long-term retention of knowledge; however, there is a significant loss of knowledge following an instructional gap, and spaced refreshers may boost retention.

Teaching veterinary surgical skills: Comparison of massed versus spaced instruction.

OBJECTIVE: To determine the effect of massed instruction (MI) versus spaced instruction (SI) of veterinary surgical skills on students' cognitive load and skill retention. STUDY DESIGN: Prospective randomized cohort study STUDY POPULATION: First-year veterinary students from Louisiana State University (LSU; n = 47) and Lincoln Memorial University (LMU; n = 101). METHODS: Students were randomized to MI (two skills in a single session of twice the duration) or SI (one skill per session on two consecutive days). Instructors, instructional ratio, and total educational time was equivalent. Following instruction, students completed a cognitive load questionnaire and underwent a structured assessment immediately after (LMU only), 1 day after, and 3-4 weeks after learning the second skill. Students completed two supervised practice sessions one and 2 weeks after the initial laboratory session(s). RESULTS: Overall cognitive load did not differ between groups (p > .05), although LMUs MI group reported higher physical and time demands, effort, and frustration. At initial assessment, SI students scored higher than MI students for the first skill at both LSU (mean checklist score = 27.7 vs. mean = 24; p = .004) and LMU (mean global rating score = 4.76 vs. mean = 4.55; p = .029). Differences between groups were no longer evident by 3-4 weeks after instruction. CONCLUSION: SI may lead to improved immediate performance; however, supervised practice was sufficient to overcome the initial disparity. CLINICAL SIGNIFICANCE: SI may be beneficial for initial skill performance. However, SI and MI students had similar performance after 3 weeks, suggesting the more convenient curricular design of MI may be sufficient as long as practice sessions are incorporated.

Retention of basic surgical skills in veterinary students.

OBJECTIVE: To quantify veterinary students' retention of surgical skills after a 5-month period without practice. STUDY DESIGN: Prospective longitudinal descriptive study. SAMPLE POPULATION: Convenience sample of second year veterinary students (n = 57). METHODS: Students practiced ovariohysterectomy (OVH) on a model during 4 clinical skills laboratories during spring 2021. Students were assessed performing OVH on their model using a validated 22-item rubric. Students not meeting expectations repeated their assessment 2 weeks later. All students had a 5-month period, including summer break, without skills practice. Students were again assessed performing OVH on their model in the fall. Students' rubric scores and pass rates were compared before and after summer break. RESULTS: Students scored lower on their retention test in fall (median = 43) than at the spring assessment (median = 56, P < .001). No difference was detected between lower and higher performing students. Five students (9%) did not meet expectations on their first assessment; more students (17/57, 30%) failed to meet expectations on their retention test (P = .004). CONCLUSION: Students experienced a decay in the surgical skills required to perform OVH after a 5-month period without practice, regardless of the quality of their initial performance. CLINICAL SIGNIFICANCE: Veterinary educators should emphasize the importance of continual practice to maintain skills and should consider assisting students in regaining skills during review sessions on models to improve surgical skill retention after a prolonged break.

Validation of a Rubric Used for Skills-Based Assessment of Veterinary Students Performing Simulated Ovariohysterectomy on a Model.

Surgical skills are an important competency for new graduates. Simulators offer a means to train and assess veterinary students prior to their first surgical performance. A simulated ovariohysterectomy (OVH) rubric's validity was evaluated using a framework of content evidence, internal structure evidence, and evidence of relationship with other variables, specifically subsequent live surgical performance. Clinically experienced veterinarians (n = 13) evaluated the utility of each rubric item to collect evidence; each item's content validity index was calculated to determine its inclusion in the final rubric. After skills training, veterinary students (n = 57) were assessed using the OVH model rubric in March and August. Internal structure evidence was collected by video-recording 14 students' mock surgeries, each assessed by all five raters to calculate inter-rater reliability. Relationship with other variables evidence was collected by assessing 22 students performing their first live canine OVH in November. Experienced veterinarians included 22 items in the final rubric. The rubric generated scores with good to excellent internal consistency; inter-rater reliability was fair. Students' performance on the March model assessment was moderately correlated with their live surgical performance (ρ = 0.43) and moderately negatively correlated with their live surgical time (ρ = -0.42). Students' performance on the August model assessment, after a summer without surgical skills practice, was weakly correlated with their live surgical performance (ρ = 0.17). These data support validation of the simulated OVH rubric. The continued development of validated assessment instruments is critical as veterinary medicine seeks to become competency based.

Practical Tips for Setting Up and Running OSCEs.

Objective structured clinical examinations (OSCEs) are used to assess students' skills on a variety of tasks using live animals, models, cadaver tissue, and simulated clients. OSCEs can be used to provide formative feedback, or they can be summative, impacting progression decisions. OSCEs can also drive student motivation to engage with clinical skill development and mastery in preparation for clinical placements and rotations. This teaching tip discusses top tips for running an OSCE for veterinary and veterinary nursing/technician students as written by an international group of authors experienced with running OSCEs at a diverse set of institutions. These tips include tasks to perform prior to the OSCE, on the day of the examination, and after the examination and provide a comprehensive review of the requirements that OSCEs place on faculty, staff, students, facilities, and animals. These tips are meant to assist those who are already running OSCEs and wish to reassess their existing OSCE processes or intend to increase the number of OSCEs used across the curriculum, and for those who are planning to start using OSCEs at their institution. Incorporating OSCEs into a curriculum involves a significant commitment of resources, and this teaching tip aims to assist those responsible for delivering these assessments with improving their implementation and delivery.

What's the evidence? A review of current instruction and assessment in veterinary surgical education.

Veterinary surgical education is improved by studying the relevant literature. The aim of this literature review was to report the theory and methods used to provide surgical education to veterinary students; to discuss the training most likely to create a competent general practitioner; and to review assessment methods for simulated and live surgeries. The literature reviewed demonstrates that new graduates are expected to perform small animal sterilization, dental extraction, onychectomy, abscess treatment, aural hematoma repair, and mass removal with little or no supervision. Students require repetitive practice to reach competence; some practice can take place in a clinical skills laboratory on models or cadavers. When training novices, distributing practice over a longer time improves retention, but months without practice causes skills to decay. Suturing skills may be taught on models at a ratio of 1 instructor per 10 students. Veterinary students require 6-10 repetitions of each small animal sterilization surgery to reach competence; however, learning curves for other surgeries have not been established. Assessment of surgical skills has been undertaken using objective structured clinical examinations (OSCEs) and observed model and live surgeries. Additional validated rubrics are needed in the field. Surgical educators are urged to continue to search for innovative ways to foster deliberate practice, assess skill, and provide feedback for students.

Evaluating validity evidence for 2 instruments developed to assess students' surgical skills in a simulated environment.

OBJECTIVE: To gather and evaluate validity evidence in the form of content and reliability of scores produced by 2 surgical skills assessment instruments, 1) a checklist, and 2) a modified form of the Objective Structured Assessment of Technical Skills (OSATS) global rating scale (GRS). STUDY DESIGN: Prospective randomized blinded study. SAMPLE POPULATION: Veterinary surgical skills educators (n =10) evaluated content validity. Scores from students in their third preclinical year of veterinary school (n = 16) were used to assess reliability. METHODS: Content validity was assessed using Lawshe's method to calculate the Content Validity Index (CVI) for the checklist and modified OSATS GRS. The importance and relevance of each item was determined in relation to skills needed to successfully perform supervised surgical procedures. The reliability of scores produced by both instruments was determined using generalizability (G) theory. RESULTS: Based on the results of the content validation, 39 of 40 checklist items were included. The 39-item checklist CVI was 0.81. One of the 6 OSATS GRS items was included. The 1-item GRS CVI was 0.80. The G-coefficients for the 40-item checklist and 6-item GRS were 0.85 and 0.79, respectively. CONCLUSION: Content validity was very good for the 39-item checklist and good for the 1-item OSATS GRS. The reliability of scores from both instruments was acceptable for a moderate stakes examination. IMPACT: These results provide evidence to support the use of the checklist described and a modified 1-item OSAT GRS in moderate stakes examinations when evaluating preclinical third-year veterinary students' technical surgical skills on low-fidelity models.

Academics' Experiences in Veterinary Educational Research: Results of an International Survey.

Research conducted by the veterinary education community is critical to continual improvement of educational outcomes. Additionally, research productivity is one metric in promotion and tenure decisions. We sought to identify challenges encountered or anticipated when undertaking or planning veterinary educational research (VER), to learn how these challenges might be overcome, and to synthesize tips for success from those who have performed VER. A branching survey was developed and deployed along the authors' worldwide veterinary education contacts in a cascading manner. The survey collected quantitative and qualitative information from participants who had performed VER and those who planned to perform VER in the future. The 258 participants represented 41 countries. Of the participants, 204 had performed VER (79%) and 54 planned to in the future (21%). The median time spent teaching was 14 years, and median time performing VER was 5 years. The most commonly reported challenges in performing VER were lack of funding, lack of time, and difficulties encountered when undertaking a study, including data collection, analysis, and publishing. When asked about overcoming the challenges, a major theme emerged around people, who provided expertise and mentoring. The most commonly reported tip for success was collaboration; 73% of experienced researchers reported people as most helpful upon beginning VER. Collaborators provided diverse help with ideas, study design, statistics, and other aspects. These results suggest that institutions can offer support to academics in the form of small grants, protected research time, writing workshops, and mentorship to assist with the production of meaningful VER.

If you build it, they will learn: A review of models in veterinary surgical education.

Surgical skills are learned through deliberate practice, and veterinary educators are increasingly turning to models for teaching and assessing surgical skills. This review article sought to compile and review the literature specific to veterinary surgical skills models, and to discuss the themes of fidelity, educational outcomes, and validity evidence. Several literature searches using broad terms such as "veterinary surgery model," "veterinary surgical model," and "veterinary surgical simulator" were performed using PubMed, CAB abstracts, and Google scholar. All articles describing a model created and utilized for veterinary surgical training were included. Other review articles were used as a source for additional models. Commercially available models were found using review articles, internet browser searches, and communication with veterinary clinical skills educators. There has been an explosion of growth in the variety of small animal surgical task trainers published in the last several decades. These models teach orthopedic surgery, ligation and suturing, open celiotomy and abdominal surgery, sterilization surgeries, and minimally invasive surgeries. Some models were published with accompanying rubrics for learner assessment; these rubrics have been noted where present. Research in veterinary surgical models is expanding and becoming an area of focus for academic institutions. However, there is room for growth in the collection of validity evidence and in development of models for teaching large animal surgery, training surgical residents, and providing continuing education to practitioners. This review can assist with evaluation of current surgical models and trends, and provide a platform for additional studies and development of best practices.

Remote Assessment of Veterinary Clinical Skills Courses During the COVID-19 Pandemic.

In spring 2020, the COVID-19 pandemic forced educators to adjust the delivery and assessment of curriculum. While didactic courses moved online, laboratory courses were not amenable to this shift. In particular, assessment of clinical skills courses through common methods including objective structured clinical examinations (OSCEs) became inadvisable. This article describes decisions made for first-, second-, and third-year veterinary students (n = 368) with respect to clinical skills at one US college. This includes the remote completion of a surgical skills curriculum using instructional videos and models and the delaying of laboratory sessions deemed impossible to deliver remotely. First- and third-year students were subsequently assessed using modified remote OSCEs. Second-year students were assessed using the standard surgical skills examination, video-recorded. All first- and third-year students successfully passed their OSCE upon either first attempt or remediation. Two second-year students failed their remediation examination and were offered additional faculty tutoring and another remediation attempt at the start of the fall semester. The remediation rate on the surgical skills examination was not different from that of previous years. One incident of suspected academic dishonesty occurred in the first-year OSCE. Students learned surgical skills successfully at home by practicing on models and receiving feedback of their skills on video recordings. While disappointing, one case of academic dishonesty among the 368 total students tested was not surprising. Remote assessment using modified OSCEs and surgical skills exams appears feasible and fair when in-person testing is not possible.

The impact of gel fingernail polish application on the reduction of bacterial viability following a surgical hand scrub.

OBJECTIVE: To determine the effect of gel nail polish application on the reduction of bacterial viability immediately after a surgical hand scrub. STUDY DESIGN: Randomized controlled trial. SAMPLE POPULATION: Ten fingernails each from 40 female health care professionals and students. METHODS: Participants' fingernails were randomized to receive no polish or gel nail polish during a manicure from a licensed manicurist. One day and 14 days after manicure, participants' fingernails were sampled before and after a surgical hand scrub with chlorhexidine gluconate. The samples for each fingernail were serially diluted, plated on a Trypsin sheep blood agar and MacConkey's agar plate, and incubated for 36 h. For each plate, bacterial colony forming units (CFU)/ml were determined. Mixed linear models were used to assess factors associated with the logarithmic reduction of viable bacterial counts from pre- to post-surgical scrub. RESULTS: In the final model, no association was detected between gel nail polish and reduction of viable bacterial count (p = .09). On Day 14, among longer nail lengths (2 to <3-mm and ≥3-mm), surgical scrubs resulted in greater reduction in bacterial counts in left-handed than right-handed participants (p < .01). Increasing nail length was correlated with increased CFU/ml post-scrubbing (p < .001). CONCLUSION: Application of gel nail polish did not seem to affect the ability of surgical scrub to reduce bacterial viability 1 and 14 days after a manicure. CLINICAL IMPACT: This study does not provide evidence to prevent application of gel nail polish on short fingernails in surgeons prior to surgical hand scrub with chlorhexidine gluconate.

Evaluation of an evidence-based veterinary medicine exercise for instruction in clinical year of veterinary medicine program.

INTRODUCTION: Evidence-based veterinary medicine (EBVM) is a fundamental core competency for new graduates. Our objectives were to evaluate clinical students' use, understanding of, and confidence in EBVM before undertaking an exercise consisting of an hour seminar in conjunction with a medical librarian, followed by a journal club and to evaluate students' knowledge of and ability to apply EBVM following the exercise. METHODS: In this cohort study, students undertaking a large animal ambulatory rotation completed questionnaires before the seminar, following the journal club, and at graduation. Students took a Fresno test evaluating EBVM knowledge at the end of the rotation. RESULTS: Prior to the seminar, 94% of students defined EBVM at least somewhat accurately, and 51% reported EBVM was at least 'quite important'. During previous rotations, 71% of students had performed literature searches to answer a clinician-assigned question; 89% had done this to answer their own questions. Students with previous research or EBVM training were more likely to perform self-directed literature searches. The most frequently used resource was textbooks. Eighty-seven per cent and 90% of students found the seminar and journal club, respectively, at least moderately useful in improving EBVM knowledge. CONCLUSIONS: Our results support the inclusion of an EBVM exercise during the clinical year and suggest spaced repetition may be helpful in teaching this topic.

Influence of instructor-to-student ratio for teaching suturing skills with models.

OBJECTIVE: To evaluate the influence of instructor to student ratio on the effectiveness and efficiency of teaching suturing skills to veterinary students. STUDY DESIGN: Prospective randomized study. SAMPLE POPULATION: Second-year veterinary students (N = 121). METHODS: Students were randomly divided into three groups to participate in four 2-hour skills laboratory sessions in which suturing of the subcutaneous tissue was taught by using a simple continuous pattern, suturing of the skin was taught by using continuous patterns, suturing of the skin was taught by using interrupted patterns, and suturing of hollow organs was taught by using inverting patterns. For each laboratory, the groups were taught by using instructor-to-student ratios of 1:6, 1:8, and 1:10 on a rotating basis. Students were surveyed at the end of each laboratory, and underwent individual performance assessments at the end of each laboratory session and again at the end of the semester in an objective structured clinical examination (OSCE). RESULTS: For each of the four in-laboratory assessments and the OSCE, no difference in performance was detected between groups. When they were surveyed, students in all groups reported that there was an adequate number of instructors in the laboratory and that they received help in a timely fashion when help was requested (median for all groups = agree). CONCLUSION: For students with prior surgical skills education and with the use of prelaboratory instructional videos, teaching at the 1:10 instructor-to-student ratio was efficient and effective. CLINICAL SIGNIFICANCE: Good educational outcomes may be reached with a 1:10 instructor-to-student ratio or, potentially, fewer instructors, depending on the educational aids present in the laboratory and students' prior level of experience.

Development and Validation of a Bovine Castration Model and Rubric.

Veterinary students require deliberate practice to reach competence in surgical bovine castration, but animal availability limits opportunities for practice. We sought to create and validate a surgical bovine castration model consisting of a molded silicone scrotum and testicles to allow students to practice this skill without the use of live animals. We sought to validate the model and associated scoring rubric for use in a veterinary clinical skills course. A convenience sample of third-year veterinary students (n = 19) who had never castrated a bovine were randomized into two groups. The traditionally trained (T) group performed castration on a live bull calf after a 50-minute instructional lecture. The model-trained (M) group received the same lecture and a 2-hour clinical skills session practicing bovine castration using the model. All students were subsequently digitally recorded while castrating a live bull calf. Performance recordings were scored by an investigator blinded to group. Survey data were collected from the students and from expert veterinarians testing the model (n = 8). Feedback from both groups was positive. The M group had higher performance scores than the T group (M group, M = 80.6; T group, M = 68.2; p = .005). Reliability of rubric scores was adequate at .74. No difference was found in surgical time (M group, M = 4.5 min; T group, M = 5.5 min; p = .12). Survey feedback indicated that experts and students considered the model useful. Model training improved students' performance scores and provided evidence for validation of the model and rubric.

The Impact of Extracurricular Surgical Experience on Veterinary Students' Performance of Canine Ovariohysterectomy and Orchidectomy in a Clinical Skills Curriculum.

Veterinary students may pursue extracurricular surgical experiences before performing ovariohysterectomy or orchidectomy in their veterinary curriculum. We sought to evaluate the impact of these experiences on student confidence and subsequent surgical performance during students' first canine ovariohysterectomy or orchidectomy during their veterinary school curriculum. We enrolled 69 third-year veterinary students to complete pre- and post-operative surveys reporting their confidence to perform surgery and self-assessing their performance. Students had all completed five semesters of surgical skills training on models and cadavers but varied in their participation in extracurricular surgical experiences. A subset of students (n = 27) were digitally recorded while performing ovariohysterectomy (16) or orchidectomy (11). Digital recordings were scored by a blinded rater using task-specific rubrics and a global rating scale, and time to perform the procedure was recorded. The number of extracurricular surgeries students had performed was positively correlated with their confidence to perform orchidectomy (r = .78) but not ovariohysterectomy (r = -.17). There was no correlation between extracurricular surgeries performed and subsequent rubric scores or surgical times for the first ovariohysterectomy (r = -.01 and r = -.14, respectively) or orchidectomy (r = .09 and r = -.18, respectively) performed as part of their veterinary curriculum. Our results suggest that extracurricular surgical experiences may not impart a long-term improvement on performance scores or surgical time during students' first surgery of their veterinary curriculum. Additional research is necessary to clarify how model training and extracurricular surgical experiences on live animals interact to affect students' subsequent surgical performance.

Video Recording in Veterinary Medicine OSCEs: Feasibility and Inter-rater Agreement between Live Performance Examiners and Video Recording Reviewing Examiners.

The Objective Structured Clinical Examination (OSCE) is a valid, reliable assessment of veterinary students' clinical skills that requires significant examiner training and scoring time. This article seeks to investigate the utility of implementing video recording by scoring OSCEs in real-time using live examiners, and afterwards using video examiners from within and outside the learners' home institution. Using checklists, learners (n=33) were assessed by one live examiner and five video examiners on three OSCE stations: suturing, arthrocentesis, and thoracocentesis. When stations were considered collectively, there was no difference between pass/fail outcome between live and video examiners (χ2 = 0.37, p = .55). However, when considered individually, stations (χ2 = 16.64, p < .001) and interaction between station and type of examiner (χ2 = 7.13, p = .03) demonstrated a significant effect on pass/fail outcome. Specifically, learners being assessed on suturing with a video examiner had increased odds of passing the station as compared with their arthrocentesis or thoracocentesis stations. Internal consistency was fair to moderate (0.34-0.45). Inter-rater reliability measures varied but were mostly moderate to strong (0.56-0.82). Video examiners spent longer assessing learners than live raters (mean of 21 min/learner vs. 13 min/learner). Station-specific differences among video examiners may be due to intermittent visibility issues during video capture. Overall, video recording learner performances appears reliable and feasible, although there were time, cost, and technical issues that may limit its routine use.